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W' exploratory study was conducted to test the 
assuaption that aultiaode knowledge of results is superior to 
traditianally presented knowledge of results in aaintaining a 
student's ijiterest and attept^pn. In additidn, tK^e felative aerit of 
pictorial fdrwait a lesfion was coapared with a basic lesson ^ > 

display. The study inVolv/ed 32 kindergarten childten randoaly ' 
assigned to fQur^reataent groiips, each group receiving a version of 
a PLATO lesson. A 2x2 factorial analysis of variance. was used to 
assess the effepts of tw^ independent variables., on four dependent 
variable^. Results of the study suggest that aultiabde knowledge of 
results aay be superior* to siaple knowledge of results in aaintaining 
a student«s;interest and attention dpring a le^sson* Subjects in the 
aultiaode conditions were less distracted than those in the siaple 
knowledge of results conditions. Type of'foraat had no effect on the 
dependent Variables perhaps because the children satiated their 
interest in pictoicialf less&n a'aterials during the wara up period. 
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laiowledge ^of results (KR) Is vd.dely .usecl as a relnforcer jji progranied 
±as\ruction and conputer-assisted liasti?uctlon despite the fact that there > ^' 
is litt;le siJbstantlating evidence fbr the assunption that KR facilitates 
learriin^in programed instruction. Much of the research" concerning the 
effects of\KR on^earnlng indicates that pr^^ teaoh as well or-befcter 

when continuous' KR is not present (Mqore & Smith, 19^1; Beldhusen & Birt/ 

. . ■ ■ ' . ' • • • . • ^ ■ . \ ^ . 

1962; Krumboltz & Weisman, 1962; Hpu^ & Revsin,. 1963; Ripple; 1963; ; 

Lublin, 1965; Jacobs & Kulkaml, 1966; Blank & Pysh; . 1970)... l^^hould , ; 

be noted that ' in each' study cited above/ KR was operationalQir def ined as.^ 

the presentation of the correct answer in printed fom following the - 

I . ^^^^^ ^ - ' * 

student's response. , Ihe applicatlcn of KR need not, l;owe.ver, be restricted 

■ ■ ■ \ ' • " ' ' ■ '/ 

to. print mode.%pr lessons adndnistfered via a cotr^iuter-based educational 

(CBE) system; rather, KR may suiDsume- a large variety of stJmilus modes 

presented after the student/ s jresponse, • Since the" reinforcing effect of ' 

KR is questionable when KR refers to printed feedback, the need for an 

alternative ±s indicated. The intention of this pap^er is to' suggest a • 

mode of presenting KIJ that is uniquely caipatible with a dynamic caiputer- 

based educational system such as PLATO IV • 

NEW MEDIUM WARRANTS NEW PEDAGOGICAL APPROACH , . " 

A sophisticated CBE system can be used effectively for the tracjitional 
pedagogical functions of diagnosis, prescription,. ; and presentation of 
subject matter. Inythis role, the system models the, best of teaGhera°*and 
ms^ be thought of as a substitute for the h,uman instructor. But the 
conputer's application. to education can transcend the limits. of perfonnlne 



ERIC 



■ tra\iitional tasks. ^ A hi^-speed computer Unkea with a graphic pictorial 

■, \ " ' » . ^ ' . * • % ■ 

display tennlnal can now. provide educational experiences arxi. resources • 

\ • • ' ■ . \ ■ . • • . ^ ' ' - ■ 

\ ■ •• • , ^- ' "A 

previously unavailable to the student. • One exanple of a new -learning 
envir^oWnt is a simulated: laboratory e^erlment; The student in this 
situation may chan^ various parameters in the experiment and then see 



the resiiLts^jof Ms manipulations ^iinnediately calculated and displayed . 
^, to him. tPor sg^^il'lc descrlptipns of /such lesspns^ see Bltzer et al. , 
'1971 and 1972. ) A-^th the adv^ced conputlJig and display capabilities 
come exciting possibilities, -In tt^ design of^^^^epZar^ Yet there ' 

seems to vbe a tendency to rely on traditional educational 'styles ani 
practices despite the fact ^at the new medium warr*ants innovative • 
pedagogical approaches that efitoody -its unique features.. Many CAI programs^ 
for example, supply i^iriforceraent In the form of printed KR sometiriBs ia 
corrbination with social relnforcers 'as in the auditory message 3 -"Gcx)d^ . 
Jolmny.. Your answer -is rl^t." Such an application is a carry-over 
from the traditional clasj»oom and does not incorporate the fuH potential 

■ of a CBE;,syste1n in admiriistering knowledge of results. Ihe, system can 
respond to the student in a "mode more cCHiiriensurate with its capabilities. 
1%, is proposed fiere that rather than supply KR through printed or ^aud^tory 
messages alone , the system should be programiK^ to respond with appropriate 

■ and. interesting changes in the visual display as well — changes involving 
pictorial or grapiiic animat^lon//Ihe key word is respond: the system 
should respond 'to the student's aqtions via every possible mode. Pre- 
Dentations of Yli which are not restricted to print or verbal modes but 
wliieh ifivolvd graphic or pictorial modes will be referred to as multlmode 
knowledge of results. ...... 

»v 
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IfJLTiMODE KNCWISDQE OF RESULTS 

Peitiaps the,natur^/of piultlnrade kncwledie of results may bes^ be 
revealed th3?ou^ exaiiple . ^ Some learning environments iriherent]y allow. 

lesson for a- young cjhild 
experimenting with word creation. Using a sci)phisticated CBE system, the 
Student may type d-oi^g pnto the screen ol* his -tei^^al; the sjjstem can 
respond^ to the child* s creation of a real work.by pronouncing, the word, 
displaying ^pictoi^al exanple of the, word .(iiioture of a dog), supplying 
appropriate sound, effects lit "arf-arf"), and using the word In context. 
Unfortunately, not all' learning tasks 16nd themselves *o visual 



presentations of iresponse cons^uence. Lesson formats whi^fti allow -for 

multlmode knowledge of results rilay be engineered for such learning tasks. 

The lessons cited below have been thus designed by the author for the 

PMTO IV system. The first lesson ig a sinple practice and drill- fo;r the 

young child learning letter-sound ass\ci^io:is. The child sees four 

magicians' hats, each containing a differSiB^IStter, on the display 

screen.*" He is given a phoneme aiirally as a deferent and is asked to point 

to its corresponding letter. If the' child ciooses the correct letter, 

a bunny hops out of that hat a^ a reward 1) and a positive audio message 

is given. (Ihe pictorial animation of the hDpping bunny along with the 

■ - • ■ - . ■ v. 
verbai message constitute multinode KR.) A wrong response evokes no 

iwnediate action on the scy^een but the child does receive verbal feedback. 

in this lesson, the "student knows that only a correct response results in 

an interesting change on the -eoreen. Perhaps this foiowlfedge motivates 

him to-^respond correctly not- onjy f or the sake of knowing he is "right" 

but also for the 'reward of seeing an" amusing animation on the' screen,^ 




■• . : . -5-:; , ^ . • • 

^ . Another lesson displaying, thfe^^^^^^^^ of multlmbde KR was designed 

for a child vdth no previous experienqe with PLATO. The child must learn 

- to. respond to the machine by touching the display screen accordingly.' 
' . ■ . ■ ^ ■ ■ ■ ■ ' 

He first learns to touch'' a prespecifLed area on the screen: fol] owing a ' 

•brief animation involving a frog, the child is to touch the rather small 

■fixig (one iriidi hi^) with his finger. It will hop across the screen if 

touched accurately (Pig. 2) and the activity will be cpntlnued until the child 

hajs accurately performed several successive touched. KR- is iaplicit; that is, 
. frog v;lll hop only when properly touched. (Verbal feedback Is provided, 

/nowever, when the child is Responding incorrectly.) * Ihls activity is 
followed by a similar activity in which the oMld himself chooses the/^a 
of the screen «to be toubhed. 'Jhe frog hops to the point , on the sc£«en 
which the child lias specified by touching. The final portion df the lesson 
JjivolvGs a display of animals that write the child's name on the. screen 
•"•^g. 3) move, or tel3? amusing jlnglec (Pig. 4 and 5) when accurately touched 
- by the child. .In all portions of the lesson, then, correct responses, (i.e. 
acGuratG touches) are rcwgirded by their appealing 'and stimulating con- 
sequences.* , 

As illustrated above, multimode ^knowledge of.j^KSults involves feed- 
' back beyond the fundamental level used in most prograns. It may Involve 
' a simple stimulus such brlpjitonlns letters that" are correctly identified 
(Fig. 6) or letters' in a correctly identified word (Fig. 7); or ifmay 
entail a more elaborate display such as pictorial animation (Fig. 9 and 10). 
In any case, it provides information to the learner about the adequacy of 
his response In a less dii^ct yet perfi(^s more reinforcing manner than 
GlJiple KR. A student may not be reinforced merely by hearing from a machine 
that he Is "rlgjit", but there is reason to believe that, in gene^. 
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Pi0. Introductory lesson. 
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Fig* 6 Lesson on graphe/ne discrimination. 

9 



cJiiidrto will be '"^tlv ways that result in interesting 

visual changes^l^d stinfi^ - ' 4 ^ ' • - 

The thedry of motivati^ supporting the use of iitultimbde knowledge . 
of results is effectance motivation, whicH'jlB iri)om desire to effect ' ■ 
stinulating chartgeg in the envirbnrr^nt with \iiichVhe is dealing. T^^'* 
desire to deal with the environment arid cause dianges in it has been 

' - ' ' - vi ; ■ : ■ " ■ • . 

reco|?ii2ed bjr many as a motiyational forces: Sohachtel (195^) claims 'that 
rp6n has a. "relatively autonomous capacity ^f or object interest" and that , • 
this interest in the environment is potentigi^ Wood^rth/ - 

(1958) considers the tendency to deal with trie- environment basic in mdti-- • 



vationt He' claJJns that direction of activity toward the environment is 
"the fundamental tendency of anim£L and* human b.diavior and that it is the • 
all-pervasive primary motivation of behavior* " . White (1959) suggested . 
the p:^eviousiy mentioned tem, effectanoe motivation, • to describo a child ^s^ 
iiiterest 'in causing pronounced effects upon thp 'enyironmerit-^by making 
somsthins.happeii as a consequence of his ac^vll^y* He -contends .thal^ a . • 
Gl^Uii is interested, in caysini phanges which offer' as Wob 03%) puts 
it J "diffarenaQ-in-sameness"> that^ is^ djaterest^s' best mairjtained when 
the chilti^G action produces one parbicul^ cliange in the stimulus field 

...» .a t ^ ' • 

'while *the: 3!^mainder- of the ileld stays oo^j^tanbi •Ohat is^not to 'imply that 
VMtei believes ..effoctance motivation is involved in eve:^y action resulting 



In some chani 



ingej; tlnterest is ^use^, ;accor<^ng>to his- theory, pnjy when 

f ' r ' *' ■ ' • ^ • » - . - • ' 

!ees |a change^ in. something that h6 is attending tp* White uses 



ithe.chil'd seesk change'^ 'in something that h6 is attending 
the idea df fo^al attm^ion-^Nji .defining his notion iDf effectande: 
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Dealing with the en\^ronment i/eans directing foG^l attention to sctne part 

'5 
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of it and orgain^^ing &.ctiQr;is. to have some effect on ,this^ parte 

f ■•■'■'! 

As applied to a coitrolled learniag envlronnient , Whitens theory of 
'\. ' ' # 

effectance motivation iini>lies^ that the student will be motivated^ to resj^Rd 

so as to . effect stimulating clianges in what he is watching. Hence.,, the y ^ 

assunpiion ban be'nade, based on th^ theory of -effectance ij^ivatlon, that r 

^ student 'will be more highly motivated in the efficacious situation - • 

afforded by multimode KRfthan in the traditional learning env;p»oi7ment \ 

accaTp5ny^|Lg fundamental K^. ' ' ' , ^ ^ ^ ' 

^OflEOTIAL ^'I^ . ^ ^ . * " ' ^ 

Mariipulatiofi of and- interaction with the environment' have already 
beeri recognlz-ed as possible relnforcers in instructional systems (Gels & 
Chapman, 1971). Glas^ (1969) elites "overt control of th^ physical 
environment" as a potentially powerful reinforcer in programed learning. 
He feays that actions causing a change |n the stiiijilus displayed to the. 
inOividual'^siay be reinforced by that change. (Indeed 3 a number of studies ^ 
have shown that visual as well as other types of sfeiinulus change can be 



reinforcing; Coferji Applet (19^) present an excellent review gf such ^ 
experiments.) • "^-v / ' 

The rei^for^cing nature of 'effectapc^ plays an imgortan^ role iii the / 
'^rfesporisive environments*; d^scritSed' by Got]rin^^v(1966 ) and Moore & 'And^^on - 
(196SP). Their talking typewri^ter is engineered to respond to the student 'sx 
explorations biy informing him inpediately about the consequencas'of .his 
actions. The talking typewriter closely -approxlmtes multimode knowledge 
of results but -is lacking 'the' capability to provide Gorrputer-based pictorial 

and ,graphi^5 animation. ^ , v 

.4 ^ - » ■ ' ■ ^ ' . ^ 

multimode knowledge of results proves to bg an* eff(^tive reinforcer. 



it will be a welcomed alternative to traditional KR.,- As* Gotkin points out, 
the assumption-that/'getting an, answer correct, and being, told \so, will- be 



Plbtorial format inay also 



just as etffective a reinforcer as a piece of candy" is apparent Ij^ mistaken, 

V . ^ \ - v 

An exploi^atory study was ,confiUcted to probe the assunption that; i , 
. . • * • ... \ ■ 

multimode knowle.dge^ of results is superior to traditionally .presented KR. 

Specif iqally, the stndy is designed' to 'determine if a^lesson involving , 

multimode KR maintains 'the student's, interest and attention better than a* 

\/brsion of the lesson providing only fteidamental KR. Also explored by . \ " 

the study >ls the .relative merit of pictorial ^'ormat " in a lesson conpared \ ^ 

with a basic lesson dlsj^ay, v\*iere pictorial format refers to the inclusion 

of nonessential display elements (pioturps). V.f a single display holds 

the student's gtjientlon as effectively as a moij^e elaborate display, desire 

- for ;cost efficiency favors the f on^^er atpproach 

^^affect^the power of jnultlmode KR in, maintaining interest; that Is pictoj:€al 
animation may^ differ.' in effectiveness from a siirple change in the visual 
stimulus. ■ ' ■ ^ ' ^ 

i ■ 

SUBJECTS AND DESIGN _ , . , . ' 

• Ihe study involved kindergarten' children fron Washington Elementary 
.SchoQj. in Champaign, Illinois. .Hie students ^were randonly assigned by , 
"boirputOT to four treatment groujs, each -group receiving a version of a 
lesson presented via PLATO. A two X two factoi^al anajlysis oT/A^iance 
was used to access the effects of the two independent variables — type . 
of knowledge of restuLts 'and type of display' format—on the\^' or* dependent " 
variables: total time spent in the lesson (T£), amount of time distracted 
from the, lesson (T2), adjusted total tame (T^ = ""^i " '^'2^^ ^ percent tnine 
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distracted of total" time (T^ = lOOiT^/Tj)). In addition, six other 
dependent variables were assessed: total nurnber of responses, number of 
^ correct responses , number of incorr^t responses , percent riesponses'^ 
'Incorrect, number of responses per maxLute, and number of letters correctly 
identified on the criterion test. (The criterion test reqiaired.the student 
to^say each letter --name that he knew aloud as it appeared on the ^screen. ) 

' MTERIALS AND APPARP^TUS ^ ^ ' \ ^ . 

Each S received a version of a drill and practice lesson on letter 

naming presented via PLATO IV, a conputer-based educational system featuring 

a random-access audio device and .a touch panel (a touch sensing panel which 

t^ - ' ' ' * ' ■ . ■ ■ 

allows the child to respond slrrply by pomtiilg to the answer), fee task ; 

■ '^t- * \ • ^ 

remained the>^ame for all.fouj? versions of the lesson. ' Ihe student was 

required' to choose (frdn ar- field of five) the letter named verbally: Ihe 

four, versions* of the lesson differed only in type of display format and 

type of KR while all other features remained ^Qons^ant . Audio messages , 

including directions and feedback^ were identical. FollowYig a cdrrect . 

response, all groups received a message randomly selectec^^vi^ "That's 

ri^t!" ahd "Good!". An incorrect response was followed by a message ran- 
domly chosen from: 
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^ — ^ No, touch a different letter. 

• No, pick another. - ^ ' 

* ^ ^ No, try again. 

Also held constant across conditions was the allowable response rate^^ all 
versions allowed a maximum of six correct responses per minute. 

■ T^pe of KR varied between versions with two groups receiving only a 
posj|.tlve audio nessagfe and^the other two receiving the audio message plus - 
a'char)ge in the visual stjjnulus Allowing a correct response. T^pe 'of display 
forrpat also Varie'd between versions with .two groups seeing a sinp^ display 

o ■ ■ 15 ■ ■ ' ■ ■ ■ • 
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of the . five letters only while the other two groups saw the letters in a 
pictorial setting of five carrots and a bunny rabbit. (Pig, 8) 

PROCEDURE ^ • ' ^ \ « 

, Each of the 32^1fcwas run indiviudally on PLATO^ beginning with a 
10-15 minute Vanm" up" time using lessons or games not difectly related 
to the subject matter of the experimental conditions. Ihis sl^ort time 
peri.od was included so as to dissipate any novelty effects of encountering 
PLATO. Just before entering the target lesson^ the student was instructed 
by ah audio Message that he would be allowed to spend as much or as little 
time in the less^on as he wished before proceding to another lessen. S was 
Instructec^o inform the proctor when- ready to stop/ The corputer-^tarted 
an internal c^ock when ,the lesson started and stopped it when the lesson 
terminated. IThus T-j. was recorded by .the teminal itself while T2 was kept 
by the observer. (T2 included time S's head was not directed toward the 
PLATO screen. \ With the exception of T2 and the score 6n the criterion 
test, all other measures were gathered and stored by the system; following 
each session, ^1 data was displayed on the screen an^^ was recorded |or . 
photographed. 

^RilSULTS 

Analysis oi\ variance*^ revealed the information presented in Tables 
1 throu^ 5 beloW. The "totaT and 'distracted time means are higher arid 
lower respectiveiy^or the multlmode TO conditions than for the simple 
•KR. groups, but the differences .are, not s.tatistically significant. The^ 
adjusted total tirte means for the multimodd KR conditions are higher ^ 
than those of the simple KR groups, and the difference between conditions 
does approach significance. The most interesting result, however, >i^, the 
.difference in T^. scores between the multimode KR conditions and the simple ■ 
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larger proportion 
other two gj^ps 



KR conditions. Sipjects In the 'mult Imode conditions spent a significantly 



of their tlrre attending to \he lesson Chan did Ss In the 



Table 1 G3X)up Scores 





ly^e off 

KR j; 






MultiiiKxie 


Sinple 


of : 

Format 


■ me^ • 


me. 9 


T 

2 

21.2 


359.7 


i».9 


Tl " 
307 .8 


' T2 . Tt 
i\5.1 263.9 


17.5 


Pictorial 


s.d. 


159.7 


17.7 


li»5.7 

i 


3.^ 


, 121.5 


26.2 123.7 


13.8 


SiJTple. 

9 


mean 


392.4 


• 41.1- 


351.3 


9.3 


3^1.7 


50.5 291.2 


16. i| 




s .d. 


170.6 


50.1 




9.1 




29.8 153.7 


10.3 





















'TalDle 2 ■ • ' - 

Analysis of Variance for 
Jependent Variable T-^ (Total time) 



Source of variation 


. d.f. , 


mean square 


F Ratio 


Probability 


lype of KR 


1- 


51,096.1 " 


• 2.19 


- .15 


Type of Format V 


1 


175.3 


.01 


.93 


X Format • • 


'1 


6,818.2 


.29 


.59 * 


error jj 


28 


23,330.6v 







r 



I 
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Table- 3 ' • 

Analysis of Variance for 
Dependent Variable T2 (Distracted Time) 



^urce of variation 


d.f. 


mean square 


P Ratio 


Probability 


lype of KR 




2,211.1 


2.0\ 


.17 


Type of Format ' 




1,275.1 


1.15 


.29 


KR X Porroat 


1 




.39 ' 


.54 


error 


28 


1,099.4 







'liable 

Analysis of variance for 
Dependent^ variable (Adjustedr..total tlirB-) 



Source of Variation 


\ d.f. 


nusan square 


P Ratio 


Probability 


Type pf KR 
lype of Format 
KR X Pqjjmat 
error 


1 

1 . 
1 

28 


64,297.0 
1,749.4 
14,170.8 

ft 

^ 20,681.2- 


■ ^ 3.11 
/ .08 
.69 ' 




.09- 

! 

.77 ' 
.41 


■1 

1 

ft' ^ Table 5 . 1 

- y * Analysis of Variance for | i 
Dependent Variable (% time distracted) 


1 


Source of Variance 


f 

d.f. 


mean square 


P Ratio 


Probability 


* 

lype of KR, J - ■• 
TVpe of Pormat 
KR X Fonncte 

■i 

error 

■ ' • ■/ 


c 

• 1 

1 • ' 

Ik 

■ 1 

28 


• 77i}.2 : 

21.5 

• 62.1^,,- ^ 
/ 98.0 


1 

7.90* 
.22 
.63 ^ 

A 


. .009*' 
.64 

.^43 



PRir 



.* p is. significant at the .01 level 
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DISCUSSICN 

The results S/Uggest that multlinode KR may ini^eed be superior to 



simple KR in malijbalnjjag the student's' Interest and attention during a 
lesson since sub/jects In the two multlmode conditions wer^ less distracted 
than those In tlte simple KR conditions—the former group spent a, larger 
percentage of tiieir time attending to the lesson. It must be pointed out, 
however, that Ss receiving only the audio message seemed to direct their 
attention towatJ^d the audio device (located next to tl^e PLATO terminal 
^- itself) during -^feedback while the Ss receiving a visual stimulus' along wlj^h 
the audio message. seemed to look at the screen during feedback. The amount 
of time §s head was directed toward anything other than the screen 
'(including the audio device) was recorded as distracted time. Perhaps 
the effects of type of KR would be different if distracted tljne was re- 
defined as time spfent -not looking at some component of the PLATO system. 
Despite this fact, the results of the study are such that further investigation 
of the liypothesis is waa:5;anted. Ihe possibility remains that multlmode , 
knowledge of results may serve as a reinforcer in computer-^ased education. 

Type of format had no effect on the dependent variables in this study,. 
One possible Explanation may be that the children spent all or part, of their 
warm up period with pictorial lesson materials ^and rrtay have experienced a 
"satiation effect on. their interest in pictures. Although this study does not 
suggest, any dif'ection for future research concerning the effects of pictures , 
in lesson material, the author believes that research^ of that nature is 
needed to guide proppjc. courseware development on PLATO. ^ 



19 



NOTES 



1 ' V 
For a general description of the^ PLATO system, and its uses see\ 
Bitzer et^. (1971 and ^72) along vdth the following : 

Alpert, D. and Bitzer, D.L. Advances in Ccxnputer-based 
Education. Science, 176, -p. I582. 

I^mian, A Sumnary of PLATO Curriculum and Research riaterials. 
Computer-based Education Research - Laborato^fyX (CERL) Report 
OS <M&^t, 1972) ■ . ^ \/ 

'1 » 

2 . ' ' 

Courseware refers to lesson materials for a CBE/ si|ij||;em as distinguished 
fiTom hardware and software . ' 

Focal attention as conceived by Schachtel refers to the individual's 
focusing or centering of attention on one particular object or event 
in the -environment to the exclusion of the remainder of the field. 



The author wishes tcj^ thank Richard J. Lutz and A. Avner for their 
assistance vdth the statistical analysis -and for Priscilla Obertino 
for her assistance as proctor. Ihe stafeistical analysis was perform^ 
through the -use '6f STAT, a PLATO lesson developed by A. Avner, and 
the SOUPAC package of the University of Illinois, Urbana. 

5 

The animal figures shown in all photographs of the PLATO displays werq 
created by Lezlie Fillman. 
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